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1. Overall Lab Description 


1.1 What does this Lab cover? 


This is an Open Lab which has been timed for one hour. 
This set of printed hard-copy instructions provide you with a choice. 
Select ONE OF either: 


e KAFKA LAB: The KafkaProducer node was added to IBM Integration Bus in 
version 10.0.0.7. In this lab, we use an IIB REST API containing a KafkaProducer 
node to write a message to a local Kafka implementation. We then use the 
KafkaProducer to send data to the Bluemix Message Hub service. 


e LOOPBACK LAB: The LoopBackRequest node was added to IBM Integration 
Bus in version 10.0.0.6. In this lab, we create an IIB REST API which exposes 
MongoDB. The IIB LoopBack Request node is used in the message flow to 
retrieve documents from the database. 


e Inthe unlikely event that you don’t want either of these options, we would also 
like to offer you the opportunity of using this Lab’s VMWare image in conjunction 
with a wider choice of (32!) possible Labs using soft-copy instructions which can 
be downloaded in PDF format from this URL: https://ibm.biz/betaworks-iib 


Communities 


BetaWorks - IBM Integration Bus 


IBM Early Programs 


~ BetaWorks - IBM You are in Community: IBM Early Programs > BetaWorks - IBM Integration Bus 


Integration Bus 
” Community Description 


Welcome to the IBM BetaWorks IBM Integration Bus (IB) community. The IBM BetaWorks team are using this community to distribute the hands on Instructional 
£ } Lab Guides that we prepare for our beta workshops. Ifwe decide to publish a Lab Guide in this Community the feature it promotes will be available in the latest 


A level of IBM Integration Bus. The Lab Guides are made available here on an “as is” basis to help you experience the latest features of IBM Integration Bus. 
i y 
Use the Files section (see the link in the left nav bar) to see the latest Lab guides 


The Lab Guides are provided on an “as is” basis however, If you have a question on a lab guide, please use the pinned topics on the Forum (link on the left of this 
page) and we will try to help. Note you will need to "Join this community" in order to post to the Forum. 


| Overview if you need to download a Developer version of IBM Integration Bus please follow this link 


Recent Updates 
A note about the Lab Guides: The Labs have been written on a Windows based IIB Environment. Some Lab guides use software that will require installation in your 


Members environment, unfortunately we can only answer questions relating to IBM Integration Bus. 

or The IIB IBM BetaWorks Team (November 2016) 

Forums 

Bookmarks Files = 
Files | Folders 

Tags 

Faai © IIB student folder (Latest Version 20th January 2017) 10) 


Updated on October 5, 2016 by Terry Hudson 
16105 add cloud connectors 


endpoint up Images mq 


DO IIB Hands on Labs (IIB 10.0.0.7) VI 


Updated on 1/18/17 by David Hardcastle 


ON please questions rest © IIB Hands on Labs (IIB 10.0.0.6) ü 


salesforce this to topic With Updated on December 12, 2016 by David Hardcastle 
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2. KAFKA LAB: Introduction and Preparation 
2.1 Introduction 


The Kafka Producer and Consumer nodes were introduced in IIB v10.0.0.7. In this lab you will use the 
Kafka Producer node. 


2.2 Scenario 

The scenario described in this lab uses an IIB REST API which updates a database HRDB. Updates that 
are made to HRDB will also be propagated to the Kafka server. The lab will start from a partially-built 
solution of the REST API called HR_Service which we will then extend to communicate with Kafka. 


2.3 Kafka servers 


This lab will investigate two Kafka servers: 


e We vill begin by investigating the use of locally-installed Kafka servers. Development and testing of 
this lab was done with three Kafka servers installed locally on the IIB workshop Windows system. 
These three servers have configured Kafka replication (replication factor three can be used for topics) 


e Next we will reproduce the same scenario, but using the IBM Bluemix MessageHub service instead of 
the local Kafka servers. MessageHub is IBMs implementation of Kafka on Bluemix. 
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2.3.1 Model Definitions 


The following message models are used by this updated version of the HR_Service REST API. 


DBRESP - contains database response information 
EMPLOYEE - defines columns in the EMPLOYEE table 


EMPLOYEE SUPPLEMENTARY - defines columns in the EMPLOYEE SUPPLEMENTARY 
table 


DEPARTMENT - defines columns in the DEPARTMENT table 


EmployeeResponse 
o DBResp (type = DBRESP) 
o Employee (Array, type = EMPLOYEE) 


DepartmentResponse 
o DBResp (type = DBRESP) 
o Department (Array, type = DEPARTMENT) 


CompleteResponse 

DBResp_employee (type = DBRESP) 

Employee (type = EMPLOYEE, single object, not array) 
DBResp_department (type = DBRESP) 

Department (type = DEPARTMENT, single object, not array) 
DBResp_employee_supplementary (type = DBRESP) 
Employee_supplementary (type = EMPLOYEE_SUPPLEMENTARY) 


000000 


EmployeeSupplementaryResponse used when only accessing EMPLOYEE_SUPPLEMENTARY) 
o DBResp 
o Emplovee supplementar 


EmployeeAddUpdateCompleteRequest (input message, used when adding a complete new 
employee) 

o Employee 

o EmployeeSupplementary 
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2.3.2 The HR_Service REST API 


The partially-built solution version of the HR_Service REST API has implemented six operations: 


getEmployee 

getDepartment 

getSupplementary (retrieves data from the EMPLOYEE_SUPPLEMENTARY table) 
getComplete (invokes the getEmployee, getDepartment and getSupplementary operations) 
createEmployeeFromMultipart (adds new employee using a MIME request) 
createEmployeeFromEmbeddedimage (adds a new employee with a plain JSON request) 


The four “get” operations are not used in this lab scenario. The two “create” operations invoke a common 
IIB subflow that performs database inserts into the EMPLOYEE and EMPLOYEE_SUPPLEMENTARY 
tables. In this lab, you will extend this subflow to publish a notification message to the Kafka server when 
a new employee is added to the EMPLOYEE tables. 


Topic=employee 
Kafka server 


Publish employee updates 


Request —————————> 
1) Multipart REST (MIME) message 


Part1 - JSON data . 
Client Part2 - File attachment (image) HR_Service_Complete REST API 


request 2) JSON message with embedded operation= 
-mage createMultipartEmployee 


Response A operation= 


Standard REST message createEmbeddedEmployee 
JSON data 


IIB node 


Insert new record to DB 


HRDB DB 
EMPLOYEE 
EMPLOYEE_ 
SUPPLEMENTARY 
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2.4 Configure TESTNODE_iibuser for REST APIs 


The instructions in this lab guide are based on a Windows implementation, with a user named 
“iibuser”. If using the workshop VMWare system, login to Windows as the user "iibuser", 


password = "passwOrd". (You may already be logged in). Start the IIB Toolkit from the Start 
menu. 


The IIB support for the REST API requires some special configuration for the IIB node and server. Cross- 
Origin Resource Scripting (CORS) must be enabled for the IIB node to execute REST applications. This 
is also required when testing with the SwaggerUI test tool. See 


http://www.w3.org/TR/cors/?cm_mc_uid=09173639950214518562833&cm_ mc sid 50200000=1452177 
651 for further information. 


1. Ensure that TESTNODE iibuser is started. 


2. Check that CORS has been enabled on the IIB node by running the following command in an 
Integration Console: 


mqsireportproperties TESTNODE_iibuser 
-e default 
-o HTTPConnector 
-r 


3. If CORS is enabled, you will see the following lines (amongst others): 


corsEnabled='true' 

corsAllowOrigins='*' 

corsAllowCredentials='false' 

corsExposeHeaders='Content-Type' 

corsMaxAge='-1' 
corsAllowMethods='GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS ' 
corsAllowHeaders='Accept , Accept-Language, Content-Language, Content- 


Type' 
4. If CORS has not been enabled, run the following commands: 
mqsichangeproperties TESTNODE_iibuser 
-e default 
-o HTTPConnector 
-n corsEnabled -v true 


mqsistop TESTNODE_iibuser 


mqsistart TESTNODE_iibuser 
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2.5 Configure Integration Bus node to work with DB2 


To run this lab, you should recreate any instances of the HRDB database. Follow the 
instructions below. You may need to alter the database schemas and authorities in the DDL 
to reflect your own environment. 


2.5.1 Create database and tables 
The HRDB database contains three tables: EMPLOYEE, EMPLOYEE_SUPPLEMENTARY and 
DEPARTMENT. These tables have already been created on the supplied workshop VMWare image. 
If you wish to create your own instance of this database (or to recreate on the workshop VM), do the 
following tasks: 


1. Login with a user that has authority to create a new database and tables (on the workshop 
VM, use the user iibadmin (password=passwOrd). 


2. Open an IIB Command Console (from the Start menu), and navigate to 
c:\student10\Create_HR database 


3. Run the commands 
1_Create_HRDB database 


2_Create_HRDB_ Tables 
4. Logout user iibadmin (or your own user). 


Appropriate database permissions are included in the scripts to GRANT access to the user iibuser. 
You may need to adjust these to match your own user definitions. 


2.5.2 Create JDBC and security configurable services 
To run this lab, the Integration Bus node must be enabled to allow a JDBC connection to the HRDB 
database. 


1. Login with your standard IIB developer login (iibuser on the workshop VM). 
2. Open an IIB Integration Console (from the Start menu), and navigate to 
c:\student10\Create_HR_ database 


3. Run the command 
3_Create_JDBC_for_HRDB 


Accept the defaults presented in the script. This will create the required JDBC configurable 
service for the HRDB database. 


4. Runthe command 
4 Create_HRDB SecurityID 


5. Stop and restart the node to enable the above definitions to be activated. As an example, on 
the workshop VM: 


mqsistop TESTNODE_iibuser 


mqsistart TESTNODE_iibuser 
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2.6 Open the Windows Log Monitor for IIB 


A useful tool for IIB development on Windows is the IIB Log Viewer. This tool continuously monitors 
the Windows Event Log, and all messages from the log are displayed immediately. 


From the Start menu, click IIB Event Log Monitor. The Monitor will open; it is useful to have this 
always open in the background. 


DR IIB Event Log Monitor 15] x] 


< IBI@NODE.serveri > The HTTP Listener has started listening on port d. 
*7?800’’ for ’’http’’ connections. [16/3/2614 3:17:23 PM] 

< IBI@NODE.serveri > Execution group finished with Configuration messa 
ge. [16/3/2614 3:17:24 PM] 

< IBi@NODE.serveri > Configuration message received from broker. [16/3 
/2014 5:87:36 PM] 

< IBiBNODE.serveri > About to ’’Change’’ an execution group. [18/37/7261 
4 5:87:36 PM] 

< IBIGNODE.serverl > About to ’’create ’’ the deployed resource ’’ Empl 
oyeeService_JSONClient’’ of type ’’.APPZIP’’. [16/3/2614 5:87:37 PM] 

< IBI@NODE.serverl > About to ’’create ’’ the deployed resource ’’ gen. 
getEmployee_EmployeeService_EmpServClient_JSON1’’ of type ’’.SUBFLOW’’. [16/3/26 
14 5:87:37 PM] 

< IBI@NODE.serveri > About to ’’create ’’ the deployed resource ’’ Emp$ 
ervClient_JSON1’’ of type ’’ .MSGFLOW’’. [16/3/2614 5:67:37 PM] 

< IBIGNODE.serverl > Execution group finished with Configuration messa 
ge. [16/3/2614 5:67:43 PM] 

< IB18NODE.HTTPListener > The HTTP Listener has started listening on p 

7*7080’’ for ’’http’’ connections. [16/3/2614 5:87:47 PM] 

< IBI@NODE.serveri > Configuration message received from broker. [18/3 
2614 5:58:41 PM] 

< IBiBNODE.serveri > About to ’’Change’’ an execution group. [1898/37261 
4 5:58:41 PM] 

< IBiBNODE.serveri1 > About to ’’delete ’’ the deployed resource ’’ Emp$ 


This tool is not shipped as part of the IIB product; please contact us directly if you would like a copy. 
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3. Explore and start the Kafka servers 


The supplied VM system has a local installation of the Apache Kafka system. The version of Kafka is 
0.10.1.0 If you are running the lab scenarios on your own system, you will need to provision your own 
installation of Kafka. Alternatively, the sections of the lab document that reference the IBM Bluemix 
MessageHub Kafka implementation will work as described. 


3.1 Kafka configuration for IIB workshop 

On the workshop VM, Kafka is installed in c:\tools\kafka_2.11-0.10.1.0. In the \bin\windows folder, there 
are a number of "bat" files that control various aspects of the Kafka system. For ease of use, some of 
these have been copied into the folder c:\student10\kafka\commands. 


On the supplied workshop VM, Kafka has been configured to use a single Zookeeper server and three 
Kafka servers. This enables a topic Replication Factor of three. If you are doing this lab on your own 
system, follow the instructions below to reproduce the same configuration. You will need three Kafka 
servers, and a topic which has a replication factor of three. 


The Kafka servers are shown schematically below. Note that all the servers are defined locally, so all 
have a unique listener port. 


Zookeeper server 


clientPort=2181 


Kafka server Kafka server? Kafka server2 


broker.id=0 broker.id=1 broker.id=2 
listener=9092 listener=9093 listener=9094 


3.1.1 Kafka installation notes 

The command files in c:\student10\kafka\commands have been tailored specifically for this lab and the 
workshop VMWare image. These make the various configuration items easier to achieve in this limited 
test environment. 

If you are running this on your own system, make appropriate changes to these command files. Note that 
each command file sets the java CLASSPATH — make changes as appropriate for your system. 


The Kafka logs have been placed in c:\kafka. This folder is referenced in the various “properties” files, 
described below. 


Set the KAFKA_HOME variable to the install folder of kafka. Append the KAFKA_HOME variable to the 
PATH system environment variable. 
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3.2 Explore the Kafka Configuration 
1. In Windows Explorer, navigate to the folder c:\student10\kafka\config. 
2. Open the file zookeeper.properties using notepad++ 


The data directory folder has been changed for use with the workshop VM system. If you are using 
your own installation, make appropriate changes here. 


#dataDir=/tmp/zookeeper 

dataDir=c://kafka/zookeeper 

# the port at which the clients will connect 

clientPort=2181 

# disable the per-ip limit on the number of connections since this is a non-production config 
maxClientCnxns=0 


Close the file when complete. 
3. Open the file server.properties. 


Most properties have been left at the default values. The following properties have been set as 
follows: 

e Delete.topic.enable=true (allows topics to be removed at server restart) 

e ~=Broker.id=0 

e  Listeners=PLAINTEXT'//:9092 

e Log.dirs=c:/kafka/kafka-logs 


If appropriate, make similar changes for your own installation, and save the file. 


# Topic deletion properties 
delete.topic.enable=true 


FAH Server Basics DAN 
# The id of the broker. This must be set to a unique integer for each broker. 
broker.id=0 


HHHHHHHHHHHHHHH Socket Server Settings ####H#HHHHHHHHHH 
listeners=PLAINTEXT://:9092 


HEHEHE AHH Log Basics #4 
# A comma separated list of directories under which to store log files 
log.dirs=c:/kafka/kafka-logs 
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4. Make similar changes to server-1.properties and server-2.properties as necessary, as follows: 


server-1.properties 
e  Delete.topic.enable=true 
e ` Broker.id=1 
e —Listeners=PLAINTEXT://:9093 
e Log.dirs=c:/kafka/kafka-logs- 1 


server-2.properties 
e Delete.topic.enable=true 
e  Broker.id=2 
e Listeners=PLAINTEXT://:9094 
e Log.dirs=c:/kafka/kafka-logs-2 


3.3 Start the Kafka servers 


On the workshop VM system, Windows shortcuts have been provided for the Kafka commands that are 


required to start the various servers. These commands can be run as “iibuser”. 


1. From the Windows Start menu (or from the desktop), open the folder “Kafka commands) 


A Kafka commands 


D All Programs 


| Search programs and files 2 


The following shortcuts will be available: 


fap|startKafka.cmd 
fap|startKafka-server 1.cmd 


fap|startKafka-server2.cmd 
(ai, startZookeeper omg 
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2. Open (run) startZookeeper.cmd. A Windows DOS command window will open and the zookeeper 
server will be started. A significant amount of log output will be produced. 


When started this way, the “startZookeeper.cmd” name will be shown in the title line of the DOS 
window. 


ci startZookeeper.cmd 


rg.apache .zookeeper.server.ZooKkeeperServer) 


(2616-12-14 13:61:56,977] INFO Server environment: java.io.tmpdir=C:\Users\iibuse 
N Corg.apache .zookeeper.server.ZookeeperServer> 
(2616-12-14 13:61:56,977] INFO Server environment: java.compiler=j?jit26 Corg.apa 
-ZooKeeperServer> 


(2616-12-14 13:61:56,977] INFO Server environment :os.name=Windows 7 Corg.apache. 
KeeperServer) 


3. Open (run) startKafka.cmd. 
As above, the server will produce some log output. 


startKafka.cmd 


[2616-12-14 13:63:27.6331 INFO [ExpirationReaper-®]1, Starting ‘Ckaf ka.server. De 1py 
rySExpiredOperat ionReaper> 


[2816-12-14 13:83:27.6331 INFO New leader is Ø (kafka.server.ZookeeperLeaderElec 
ener) 


[2816-12-14 13:03:27.633] INFO [ExpirationReaper-®], 
rySExpiredOperat ionReaper> 
[2816-12-14 13:83:27.6641 INFO [GroupCoordinator 8]: 


Starting (kafka.server.Del 


Starting up. (kafka.coordin 


4. Repeat with startKafka-server1.cmd and startKafka-server2.cmd. 


5. Atthis point, all Kafka servers are running, so now create a new topic. 


Open a new DOS window, and change directory to c: \student10\kafka\commands 


6. Run the createTopic.cmd file. 


Provide the following values: 
e Topic: employee 
e Replication factor: 3 
e Partitions 2 


G:\student18\Kafka\commands >createTopic.cmd 


C:\studenti@\Kafka\commands>echo off 
Enter topic to create (default is employee>: employee 


Enter Replication Factor for employee (default is 1): 3 
Enter number of partitions to create (default is 1>: 2 
Created topic “employee”. 
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7. Run the command file ListTopics. cmd. 


The command will return “employee”. 


C:\studenti@\Kafka\commands>cmd /c “kafka-topics.bat --list --zookeeper localhost:2181" 


employee 


8. Run the command file describeTopic. cmd. 


Provide “employee” as the topic name. The command will return information about the replication 
factor and partitions of the “employee” topic. If you have followed the instructions above, you will 
see output similar to that below. 


C:\student1@\Kaf ka\commands >describeTopic.cmd 


C:\studenti@\Kafka\commands>echo off 

Enter topic to describe (default is employee>: employee 

Topic:employee PartitionCount:2 ReplicationFactor:3 
Topic: employee Partition: @ Leader: 2 Replica 
Topic: employee Partition: 1 Leader: @ Replica 


9. Run the command consumeMessages.cmd. 
Specify the “employee” topic, and connect to the Kafka server with port 9092. 


G:\student18\Kafka\commands >consumeMessages .cmd 


C:\studenti@\Kafka\commands>echo off 

Enter topic that you want to consume from (default is employee>: employee 

Enter port that you want to connect to Cserver=?692, server1=9693. server2=9694. default is 9@92>: 9 
092 


10. Open a further DOS windows, and navigate to c!\student10\kafka\commands. 
Run the command produceMessage. cmd. 
Specify the “employee” topic, and connect to Kafka with port 9092. 
Type some text message input, as shown below. Each message is terminated with the Return key. 


G=:\student18\Kafka\commands >produceMessage .cmd 


C:\student1@\Kafka\commands>echo off 
Enter topic you want to produce messages to (default is employee>: employee 


Enter port that you want to connect to (server=9692, server1=-9893, server2=9894, default is 9892): 9 
892 
test message 1 
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11. Back in the consumeMessages window, observe that the text messages you just produced have 
been consumed by the consumeMessages client application. 


C:\studenti@\Kaf ka\commands >consumeMessages .cmd 


C:\studenti@\Kafka\commands>echo off 

Enter topic that you want to consume from (default is employee): e 
Enter port that you want to connect to (server=?692, server1=-9093, 
892 

test message 1 

test message 2 

final message 


You have now verified that the local Kafka system is configured correctly, and can be used by the 
IIB applications. 
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4. Import and extend the HR_Service REST API 


In this section you will extend the provided REST API, HR_Service. The provided version of HR_Service 
has already implemented the two createEmployee* operations. Both these operations use the 
createEmployeeMain.subflow. This subflow is the component that will be extended in this section. 


1. 


If you already have a workspace open, click File, Switch Workspace. Give the new workspace the 
name 


c:\users\iibuser\IBM\IIBT10\workspace_kafka 


In the new workspace, import the Project Interchange file: 


C:\student10\HR_complete\HR_Service\resources\ 
HR_Service_Kafka_StartingPoint.10.0.0.7.zip 


Select all three projects from this PI file, and click Finish. 


HR_Service uses the EMPLOYEE, EMPLOYEE_SUPPLEMENTARY and DEPARTMENT tables 
from the HRDB database. This requires the HRDB Database Definition project, which represents 
the tables schemas. This is used by the Mapping nodes that access these tables. The HRDB 
Shared Library and HRDB_project items contain the database definitions for the DB2 database 
HRDB. 


Note — because the EMPLOYEE_SUPPLEMENTARY table has been added in the 10.0.0.7 version 
of this lab series, the HRDB.dbm file has been updated in this version of the HRDB shared library. 
However, it is backward-compatible with earlier versions, and can be used with earlier lab scenarios 
from this series. 


ois 
Import Projects — 
Import Projects from a zip file. | = 
= A 


From zip file: C:\student10\HR_complete\HR_Service \resources\HR_Service_Kafka_StartingPoint.10.0.0.7.zp el Browse... | 
Project location root: [ €: users \ibadmin \IBM \[IBT 10 \workspace_kafkal Browse... | 


WEHRDB 
WEHRDB_project 
ZHR Service 


Select All | Deselect All | Select Referenced 
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3. When imported, you will see the HR_Service REST API project, and the HRDB shared library. The 
shared library has a library reference from the HR_Service REST API. 


You will see several subflows are present in HR_Service. This indicates that several operations 
have already been implemented in this REST API. In addition, there are other subflows that are for 
more general use. 


Expanding the REST API Catalog will show the entire list of operations that are defined in this 
REST API. As mentioned above, not all of these operations have been implemented. 


Note that the “HR Employee and Department Services.json” document has been updated to 
Version 4.0.0. This is because new Model Definitions have been provided for the new database 
table, and all “Get” operations have been changed to use the “query parameter” form of a REST 
request with a “get” method. 


Application Development New... 


= = Resources 
+- EE Flows 
= Gs Subflows 
Ea createEmployeeFromMultipart.subfiow 
Ea createEmployeefromtEmbeddedimage.subflow 
Fla createEmployeeMain.subflow 
` e getComplete.subflow 
` Da getDepartment.subfiow 
Ea getEmployee.subfiow 
Els getSupplementary.subflow 
© Maps 
gi ESQLs 
-- REST API Catalog 
ZG HR Employee and Department Services 4.0.0 
"TT createDepartment 
"mr createEmployee 
8 createEmployeeFromMultipart 
-E createEmployeefromtEmbeddedimage 
> getComplete 
>E getDepartment 
= getDepartments 
= getEmployee 
= getEmployees 
> getSupplementary 
` TT postEmployee 
mr" postSupplementary 
(eu Referenced Libraries 
+] Other Resources 
2 HRDB 
=|) Other Resources 
2 Le HRDB_project 


vs 


F-- 
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4. Open (double-click) the REST API Description. This will show the Header and Resources 


definitions in the REST API. 


The “get” operations are not described here. If you need information on how to construct these 
operations, please refer to various lab documents earlier in this series, for example 


10006_16L01/02. 


5 Applic... 38 22, Patter... 


ZG 
Application Development 


Gs HRDB 
=} Other Resources 
Log HRDB_project 
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= m HR_Service 53 


New... » Header 


~ Resources 


> /departments 

> /departments/department 

> /employees 

> /employees/complete 

> /employees/complete/embeddedimage 
> /employees/complete/multipart 

> /employees/employee 


> /employees/supplementary 


Session 9402, IBM Integration Bus 
5. Further down the HR_Service editor, you will see the supplied Model Definitions. 


Expand the supplied models. These will be used later in the lab. 


~ Model Definitions 


El {.-} EmployeeSupplementaryResponse 
DBResp 
Employee_supplementary 

= {..} EmployeeAddUpdateCompleteRequest 


TTTTTITTTTTTTITTTTTTTTTRTTTTT? 
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6. Expand the /employees/complete/embeddedimage resource. 


You will see a POST operation has been created in this resource. 


Parameter type Data type Format Required Description 


Request body 


Schema type 


[The request body for the operation [JpdateCompleteRequest 7] 


Arri 


Response status 


| 200 [The operation was successful. Oo 


Description 


7. Use the slide bar to move to the right, and open the subflow that implements this operation. 


© 


8. The subflow invokes a further subflow, createEmployeeMain, where the main logic for this 
operation is provided. 


Ea createEmployeefromtEmbeddedimage.subflow 33 
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9. 
operation also invokes the same subflow. 


Ca createEmployeefromtEmbeddedimage.subflow 


| Flow Exerciser: 


Ea createEmployeeFromMultipart.subflow 53 


Similarly, in the /employees/complete/multipart resource, the createEmployeeFromMultipart 


i 


Input 


x Ein 
ei / 
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P SÉ 


ReparseAndSavelmage i 


Reset Content Descriptor MIME domain 


dë 


createEmployeeMain 
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4.1 Investigate the createEmployeeMain subflow 


1. From either of the two operation subflows mentioned above, open (double-click) the 
createEmployeeMain subflow. 


This subflow is complete, with the exception of a space for a KafkaProducer node. 


However, there are some additional features of some other nodes which will be explored, 
although no further development work is required for these. 


AEP, E" createGeneralDatabaseFailureResponse 


savelnEnvironment E | 


Write file record if Kafka fails 


e Ei \ = 


wo + ES i ` 
Insert new Employee into database #7 B- prepareKafkaMessage 2m: 5——_-~* ] 


Check success, duprec, or DB failure 


createSuccessResponse Output 


createDupRecResponse 
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2. Open the “Insert new Employee into database” mapping node. This map accesses three 
database tables, all in the HRDB database, as follows: 


e Select from HRDB(DEPARTMENT) 
e Insert into HRDB(EMPLOYEE) 
e Insert into HRDB(EMPLOYEE_SUPPLEMENTARY) 


If all database operations are successful, all data is placed in the output message assembly, 
with the exception of the binary image element of the input message (see step 6 below). 


B create_insertNewEmployeeIntoHRDB 


ycreate_insertNewEmployeeIntoHRDB 


2 8| BIER E puaa & 
B = [55 Message Assembly 
FP <Click to filter... > 
= dëi Properties 
= df] ISON 
[E] Padding 
= Te] Data 


DBResp_employee 


5 SS Message Assembly JSON 


FP <Click to filter... > 
5B Move + k| 


E Af! Properties PropertiesType 


Œ gf] LocalEnvironment _LocalEnvironmentType 


S gp] JSON 
€] Padding 


JSONMsgType 


string 


Employee 


DBResp_department 


Department 


EmployeeAddUpdateCompleteRequest 


+ Ze Data 


[E] DBResp_employee_supplementary 


Employee_supplementary 


= Bl Insert into HRDB/IIBADMIN/EMPLOYEE 
$o <Click to filter...> 


= DE Select from HRDB 
3 <Click to filter... > 


p a = $ Insert into HRDB/IIBADMIN/EMPLOYEE_SUPPLEMENTARY 
SP <Click to filter... > 
E EMPNO_SUPP 
8 EMAIL 
E MOBILEPHONE 
E TWITTERID 
E BoxID 
| E IMAGE 


m TO ResultSet Result Set Row 


3. Highlight the first Insert transform. The input Data element and the output “Insert into 
HRDB/IIBADMIN/EMPLOYEE” elements are highlighted. 


If you want to see the precise elements mappings, click the “Insert” text of the transform. 


Return to the highest level of the map when finished. 


= [53 Message Assembly 
>» <Click to filter... > 
| @ El Properties 


5 Pal Message Assembly 
> <Click to filter... > 


o EI Properties PropertiesType 


® gf] LocalEnvironment 
= EI ISON 
[E] Padding 


_LocalEnvironmentType 
JSONMsgType 


string 


# [e] Employee 


EmployeeAddUpdateCompleteRequest 


EMPLOYEE 


= [E] EmployeeSupplementary 


EMPLOYEE_SUPPLEMENTARY 


© 2a] Select from HRDB 
> <Click to filter... > 


e O ResultSet 
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Result Set Row 


5 EI ISON 


[E] Padding 


a fie] Data 


+ 


+ 


+ 
+ 
+ 
+ 


G 


E 


DBResp_employee 
Employee 

DBResp_department 

Department 
DBResp_employee_supplementary 


Employee_supplementary 


| 


© ‘Sa Insert into HRDB/IIBADMIN/EMPLOYEE 
FP <Click to filter... > 


15 WE Insert into HRDB/IIBADMIN/EMPLOYEE_SUPPLE 
FP <Click to filter... > 


E EMPNO_SUPP 
E EMAIL 
E MOBILEPHONE 
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4. Similarly, highlight (click) the second Insert transfom (not the “Insert” text). The same input 
will be highlighted, and the output assemly for the EMPLOYEE_SUPPLEMENTARY table 

will be highlighted. 


Again, if required, click the word “Insert” to see the precise mappings. 


DBResp_employee 


Employee 


DBResp_department 


€] Department 


EmployeeAddUpdateCompleteRequest 1 DBResp_employee_supplementary 


€] Employee_supplementary 


‘|e Sg Insert into HRDB/IIBADMIN/EMPLOYEE 
> <Click to filter... > 


= [e] Employee [0..1] EMPLOYEE 


= #8 Insert into HRDB/IIBADMIN/EMPLOYEE_SUPPLE 
3% <Click to filter... > 


= [E] EmployeeSupplementary [0..1] EMPLOYEE_SUPPLEMENTARY 


=) $F Select from HRDB @ EMPNO_SUPP 
Žo <Click to filter... > E EMAIL 
i f MOBILEPHONE 
B TWITTERID 
5 Soup 
f IMAGE 


a TỌ ResultSet ..*] Result Set Row 


5. Highlight and click the Return transform shown. Note the input and output connections that 
have been made for this transform. 


DBResp_employee 


[E 
[E] Employee 


[E] DBResp_department 
€] Department 


[1..1] EmployeeAddUpdateCompleteRequest J [E] DBResp_employee_supplementary 
e 


Employee_supplementary 


| ch B Insert into HRDB/IIBADMIN/EMPLOYEE 
>» <Click to filter... > 


€] Employee [b..1] EMPLOYEE 
[E] EmployeeSupplementary [0.1] EMPLOYEE_SUPPLEMENTARY 


| (=) Insert into HRDB/IIBADMIN/EMPLOYEE_SUPPLE 
Fo <Click to filter... > 


6. Finally in this map, click the word “Return” to see the precise element mappings. 


Note that the IMAGE element is not mapped. This is because this element will probably be 
quite large, and we don’t want to send this back to the originating client. 


= %] DBInsertReturn <Anonymous > S [€} Employee_supplementary EMPLOYEE_SUPPLEN 
$P <Click to filter...> >» <click to filter... > 


€] EMPNO_SUPP 1 <string> 


€] NumberOfRowsInserted a. int 


[E] EMAIL 1 <string> 
EmployeeAddUpdateCompleteRequest €] MOBILEPHONE ..1] <string> 


<Click to filter...> TWITTERID <string> 


Employee ..1] EMPLOYEE BOXID ..1] <string> 


[E] EmployeeSupplementary [0..1] EMPLOYEE_SUPPLEMENTARY [E] IMAGE Lä sting? 


EI EMPNO_SUPP ke <string> 


= E = = B} DEResp_employee_supplementary DBRESP 
€] EMAIL ..1] <string> EMove 


3» <Click to filter... > 


` ` EE]Move v 
MOBILEPHONE 0 <string> RH UserReturnCode 1] <integer> 


TWITTERID ..1] <string> EMove v RowsRetrieved ..1] <integer> 


Es SE Wi Move v el RowsAdded 1 <integer> 


ES Assign ~ RowsUpdated ba <integer> 


IMAGE ..1] <string> 


RowsDeleted ..1] <integer> 


SQLCODE_Errorcode ..1] <integer> 
[E] SQLSTATE_SQLState ..1) <string> 


Close the map. 
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7. 


Highlight the “Check success, duprec, or DB failure“ Route node. 


In the properties of this node, the filter pattern has been set to check for successful inserts to 
both the EMPLOYEE and EMPLOYEE_SUPPLEMENTARY tables. If RowsAdded=1 for both 
of these tables, then the message will be sent to the Match terminal, and to the 
KafkaProducer node (to be added). All other responses represent failures of various kinds. 


E Properties $3 ; o z Fo rt 
3 Route Node Properties - Check success, duprec, or DB failure 


|__| @ Filter table: Filter pattern: The Data element in XPath $Root/JSON/Data/DBResp_employee/RowsAdded=1 and $Root/JSON/Data/DBResp_employee_supplementary/RowsAdded=1 was r 
Description found in the XML Schema. 
Basic 


—— ____ Filter table* 
Monitori 


$Root/JSON/Data/DBResp_employee/RowsAdded=1 and $Root/JSON/Data/DBResp_employee_supplementary/RowsAdded=1 Match 
$Root/JSON/Data/DBResp_employee/SQLSTATE_SQLState=23505 dupRec 


Open the prepareKafkaMessage map. 


The output message assembly has a single JSONObject element, employeeAdded. This 
element is set to the value of the employee number (EMPNO), before being published to the 
Kafka server in the subsequent node. Consuming applications will receive this small 
message, and be able to retrieve the full information from the EMPLOYEE and 
EMPLOYEE_SUPPLEMENTARY tables. 


e create_prepareKafkaMessage 


vcreate_prepareKafkaMessage H Ei | å S| 3% DI ER Se ees dl E 


= hl Message Assembly = e Message Assembly 
Fo <Click to filter... > Fe <Click to filter... > 


E v a [E] 
D El Properties LA PropertiesType RE e gF] Properties ..1] PropertiesType 


JSON — 1 JSONMsgType 


SE? 
3 gp] ISON ..1] JSONMsgType ae 


€] Padding be string 


Padding ..1] string 
3 & choice of cast items 


E Data ..1] anyType 
JSONObject 


CompleteResponse 
DBResp_employee be DBRESP 


Employee ..1] EMPLOYEE 3 fg Data 
3 & choice of cast items 


Bany 


T employeeAdded 


[E] EMPNO ..1] <string> 


€) FIRSTNME n1] <string> 
d 

[€] MIDIN: ..1] <string> 
IDINIT a 


[€] LASTNAME ..1] <string> 
g 


Close the map. 
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9. From the Kafka drawer, drop a KafkaProducer node onto the subflow, name it 
“KafkaProducer - Local”, and connect as shown. 


Connect the Failure terminal to the In terminal of the FileOutput node. 


\ f, \ E KáfkaProducer -Local ` We file record if Kafka fails 
Insert new Employee into database Jo z > PrepareKafkaMessage‘ = | = Bel N 
Check success, duprec, on DB failure 3 SC ON 
\ GreateSuccessResponse, “ Output 
e 
10. Inthe properties of the KafkaProducer node, set the following properties: 
e Topic: employee 
e Bootstrap server: localhost:9092 
e Acks: 1 
Properties £3 m Problems BE Outline $A Tasks Œ Deployment Log 
| KafkaProducer Node Properties - KafkaProducer - Local 
Topic name* [employee 


Bootstrap servers* | localhost:9092 


= e.g. bootstrap.server.com:9092 (multiple servers can be specified and delimited using a `) 
Ze Cient ID ee 
Add IIB suffix to dientID M 

Acks* 
Timeout (sec)* 
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11. Review the properties of the FileOutput node. 


The properties have been specified to work on a Windows system, and to write an output file 
to the folder c:\kafka\files_noKafka, if the KafkaProducer node should fail. 


If you are running on a non-Windows system, or you want to change the output folder 
destination or file name, make appropriate changes now to these properties. 


E Properties £3 


He: + = 


Y- 


Al File Output Node Properties - Write file record if Kafka fails 


Records and Elements 


12. Save the subflow. 


D mg, 
fc: \kafka\files_noKafka 
File name or pattern \ | employeeAdded.log 


File action 
Mode for writing to file 

@ Write directly to the output file (append if file exists) 

© Stage in masitransit directory and move to output directory on "Finish file” 


Action if file exists [Replace Existing File 


Replace duplicate archive files [~ 


Action on final file transfer failure [No Action 


Directory 


Deploy the HRDB Shared Library and then the HR_Service REST API to 
TESTNODE_iibuser/default in the usual way. 
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5. Test the updated HR_Service REST API 
5.1 Using SOAPUI 


1. Open SOAPUI and create a new REST project. 


$ New REST Project xj 
Creates a new REST Project in this workspace 


2. Inthe URI field, specify the following URI, and click OK. 


http: //localhost :7800/HR_Services/resources/employees/complete/embeddedimage 


$ New REST Project x| 
Creates a new REST Project in this workspace 


URI: |'800/HR_Services/resources/employees/complete/embeddedimage 


CEES 


Page 30 of 76 
IBM InterConnect 


Session 9402, IBM Integration Bus 


3. Change the method to a POST. 
In the input data area, paste the entire contents of the file 


c:\student10\HR_complete\HR_Service\data\ 
EmbeddedImageWholeMessage.raw. json 


Note that the last data line (highlighted in yellow below) is a binary image of the new 
employee, encoded as a Base64 text encoded string. 
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v 


~ 
un 
H 
=] 
Er 
D 

œŒ 
= 
m 

a 


ris required 


av 
Media Type |appiicationfison__|¥ [Post Querys... 
{ 


“Employee”: { 
"EMPNO": "000015", 
"FIRSINME": "Albert", 
"MIDINIT": "J", 
"LASTNAME"- "Einstein", 
"WORKDEPT": "A00", 
"BHONENO": "5012", 
"HIREDATE": "2016-12-12", 
"JOB": "MGR", 
"EDLEVEL": 9, 
"SEX": "M", 
"BIRTHDATE": "1879-03-14", 
"SALARY": 20000, 
"BONUS": 5000, 
"COMM": 1024 


I, 
"EmployeeSupplementary": { 


"EMPNO SUPP": "000015", 

"EMAIL": "a.einstein@zurich.com", 
"MOBILEPHONE": "7845364535", 
“TWITTERID": "@EMC2”, 

"BOXID": "EMC2@box.com”, 

"IMAGE": 
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4. Change the EMPNO to an employee number that does not already exist in the EMPLOYEE 


table (000028 in this example). 


Click the green arrow to send the request. 
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v 


Raw ) Request 


r Method Endpoint | 
= post _ deiere 2 


ZG “e m] v a 


"FIRSTNME": "Albert", 
"MIDINIT": "J", 
"LASTNAME": "Einstein", 
"WORKDEPT": "A00", 
"PHONENO": "5012", 
“HIREDATE": "2016-12-12", 
"JOB": "MGR", 

"EDLEVEL": 9, 

"SEX": "Me, 

"BIRTHDATE": "1879-03-14" 
"SALARY": 20000, 

"BONUS": 5000, 

"COMM": 1024 
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5. If successful, the response message will be shown. 


/HR_Services/resources/employees/complete /embeddedimage 


[]<Response xmins="http://localhost/HR_Services/resources/emf 
<DBResp department> 
<RowsRetrieved>1</RowsRetrieved> 
<UserReturnCode>0</UserReturnCode> 
</DBResp_department> 
<DBResp_employee> 
<RowsAdded>1</RowsAdded> 
<UserReturnCode>0</UserReturnCode> 


| Raw "` HTML) JSON ) XML 


</DBResp_employee> 
= <DBResp_ employee supplementary> 

<RowsAdded>1</RowsAdded> 
<UserReturnCode>0</UserReturnCode> 

</DBResp_ employee supplementary> 

E <Department> 

<ADMRDEPT>A00</ADMRDEPT> 
<DEPINAME>SPIFFY COMPUTER SERVICE DIV.</DEPTNAME> 
<DEPTNO>A00</ DEPTNO> 
<LOCATION null="true"/> 
<MGRNO>000010</MGRNO> 

</Department> 

<Employee> 
<BIRTHDATE>1879-03-14</BIRTHDATE> 
<BONUS>5000</BONUS> 
<COMM>1024</COMM> 
<EDLEVEL>9</EDLEVEL> 
<EMPNO>000028</EMPNO> 
<FIRSTNME>Albert</FIRSTNME> 
<HIREDATE>2016-12-12</HIREDATE> 


6. Switch back to the DOS command window which was consuming messages from the Kafka 
employee topic. 


Note that a message has been received with the employee number of the newly added 
employee (000028 in this example). 


C:\studenti1@\Kafka\commands>echo off 
Enter topic that you want to consume from (default is employee): employee 


Enter port that you want to connect to (server=9092, server1=-9893, server? 
892 


test message 1 


test message 2 

final message 
<"employeefAdded": "888026 > 
<"employeeAdded '866627"'> 
<"employeefAdded": "898028"? 
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5.2 Using Postman 

Although most REST testing tools, such as SOAPUI, are capable of generating and sending a REST 
request with an accompanying JSON payload, not all are capable of sending a MIME request in multipart 
format. The HR_Service REST API has two operations to create a new employee. The second of these 
expects such a message, so this section uses the Chrome Postman tool to send this request. Postman is 
described in more detail in the lab guide 10006_16L15 document. 


1. Open the Postman tool from the Start menu and import the Postman collection “Complete” 
(depending on your VM image this may already be there - if so, replace it). This is available 
in the export file 


c:\student10\HR_complete\HR_Service\postman\ 
Complete.postman_collection.json 


2. Expand Complete, and select the “Add (Complete) — using multipart image” test. 


On the details pane, select the Body tab. The data format will be set to “form-data”. 


DT Runner è impor ` 7}. Builder w @& Signin A £ Y 


Add(Complete)- @ e 


llection 
Collections Add (Complete) - using multipart image 


POST http://localhost:7800/HR_Services/re Params Save 


Post Add (Complete) - using multipart image 


Enbeddedimae: 
Embeddedimage Choose Files | N. 


Multipart 
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3. For the employeelmage part of the message, set the attached file to 
c:\student10\HR_complete\HR_service\data\Einstein. jpg 


Set the EMPNO element to an employee value that is not yet in the database. The example 
below shows “000029”. 


Add (Complete) - using multipart image 


Choose Files | E 


4. Click Send. 
The new employee will be added successfully. 


The new employee will be published to Kafka, and the consuming application will receive the 
new notification, as before. 


C:\studenti@\Kafka\commands>echo off 
Enter topic that you want to consume from (default is employee): employee 


Enter port that you want to connect to (server=9992, server1=9093. server2=9094, 
892 


test message 1 
test message 2 


final message 

<"employeeAdded': "888826 > 
<"employeeAdded": "000027"? 
<"employeefAdded": "686828 "> 
<"employeefAdded": "668629 ''> 
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6. Using the Kafka nodes with IBM MessageHub 


The IIB Kafka Producer and Consumer nodes can also be used with the MessageHub service provided on 
IBM Bluemix. MessageHub is IBMs implementation of Apache Kafka. More information can be found here: 
https://developer.ibm.com/messaging/message-hub/. 


6.1 Explore and configure MessageHub 


1. To use the Bluemix MessageHub service, you will need to login with an IBM ID. If you do not 
have an IBM ID, create one now, and then return to the next step. 


2. Login to the MessageHub service on IBM Bluemix: 


https: //console.ng.bluemix.net/catalog/services/message-hub 


When you have logged in, make sure that the Bluemix Region is set to the value that you 
want to use for your own testing. In the example below, the region for the BetaWorks 
organization is “United Kingdom”. 


Account Account 


Region United Kingdom 


Organization BetaWorks 


Space dev 


Manage organizations Create a space 
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3. Inthe Bluemix Catalog, type “Message Hub” into the search field. 


Click the Message Hub icon. 


212 Trial Days Remaining e David Hardcastle's Accoun... ted Kingdo orks ` de (el 


IBM Bluemix Catalog Catalog Support Account 


All Categories (1) 


Infrastructure 


Services 


Compute 


Application Services 


Deliver new web and mobile apps. 


Apps Message Hub 


IBM Message Hub 


Boilerplates is a scalable 


ud Foundr 


IBM 


4. Click Create to create a new Message Hub service. 


Message Hub 


IBM Message Hub is a scalable, Service name: 
high-throughput message bus. Wire 
micro-services together using open m ge Hub-a3 
protocols. Connect stream data to 

R Credential name: 
analytics to realize powerful insights. 
Feed event data to multiple applications Credentials-1 
to react in real time. Bridge to your 
on-premise messaging infrastructure to 


create a hybrid cloud messaging 
E Features 


IBM Fast, scalable, fully managed messaging + Streaming analytics integration 
service, based on Apache Kafka Use the power of the Apache Spark and 


Message Hub sits on Apache Kafka, an Streaming Analytics services alongside Kafka 
Connect to: S 
open-source, high-throughput messaging to build high-performance scalable streaming 
system which provides a low-latency analytics solutions. 
Leave unbound platform for handling real-time data feeds. 
e Communication using Kafka, MQ Light or e Connectivity with a range of services 
View Docs REST API clients Message Hub will integrate with multiple 
Message Hub provides 3 interfaces services on Bluemix. 
through which messages can be produced 
AUTHOR IBM 
Dun and consumed. The native Kafka interface 
PUBLISHED 06/23/2016 for Kafka clients, the MQ Light API for MQ 
TYPE Gene Light clients, and a REST API. 


Need Help? Estimate Monthly Cost 
Contact Bluemix Sales Cost Calculator 
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5. The new Message Hub service will be created. The views may look slightly different but 
should be similar to what is shown below. 


Message Hub-a3 


Manage 


Filter Topics... Ey 


Partitions: 0 used / 0 maximum 


[ o [beter A | 


Topic Names Partitions Retention (hours) 


No Topics Found 


6. Create a new topic, by clicking the “Create topic” icon. 


Topics 


| Filter Topics... 


Partitions: 0 used / 100 maximum 


—_ 


Topic Names Partitions Retention (hours) 


No Topics Found 
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7. Name the new topic “employee” and press Return. 


Topic Names Partitions Retention (hours) 


| employee] 1 + [24 ml Save Gi 


No Topics Found 


The new topic will be created with a retention period of 24 hours. 


Topic Names Partitions Retention (hours) 


Topic ‘employee’ created. 


8. Click the “Service Credentials” tab. 
Click the “View Credentials” drop-down. 


Note the server URL values, and the user and password values. These will be used by the 
IIB KafkaProducer node that you update shortly. 


Message Hub-a3 


Manage Service Credentials ‘Connections 


Service Credentials Service Credentials New Credential 


Credentials are provided in JSON format. The JSON [C] KEY NAME DATE GREATED ACTION 
snippet lists credentials, such as the API key and secret, as 
well as connection information for the service. D credentials-1 


Dec 14, 2016 - 05:05:39 View Credentials = 


{ 

"mqlight_lookup_url": "https: //mqlight-lookup-prod02.messagehub.services.eu-gb.bluem 
ix.net/Lookup?serviceld=845afee0-a856-4726-a2c5-af90b2e7ebd7", 

"api_key": "yt3ApcyClTbrd7H9nb0zXz466PHOcRvDmNAhhwZ3FdBgJoR1", 

"kafka admin url": "https://kafka-admin-prod02.messagehub.services.eu-gb.bluemix.net 
2443", 

"kafka_rest_url": "https: //kafka-rest-prod02.messagehub. services.eu-gb.bluemix.net:4 


"kafka02 proces mes een eee eee cena eps DOE, 


"kafka03-prod02.messagehub. services.eu-gb.bluemix.net: 9093", 


"kafka04-prod02.messagehub. services.eu-gb.bluemix.net: 9093", 


yices.eu-gb.bluemix.net:9093" 


"user": "yt3ApcyClTbrJ7H9", 
"password": "nb0zXz466PHOcRvDmNAhhwZ3FdBgJoR1" 
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9. 


Return to the Integration Toolkit, and edit the createEmployeeMain subflow. 


Add a new KafkaProducer node to the flow. Name it “KafkaProducer MessageHub”, and 
connect it as shown. 


Be sure to remove the connection to the KafkaProducer Local node — or you will get logic 
errors at runtime. 


es 


spreinenwronmnt BE ——ER 


KafkaProducer -Local ` “Write file record if Kafka fails 


\ 8 f ~ @ B \ . 3 
Insert new Employee into database u” u prepareKafkaMessäge f le E k | 
Check success, duprec, dr DB failure \ A 
a \ createSuccessResponse Output 


KafkaProducer MessageHub 


—— A 


createDupRecResponse 


Select the properties of the KafkaProducer MessageHub node. 


On the Basic tab: 
e Topic: employee 
e Bootstrap server: kafka ............... bluemix.net:9093 (copy/paste the first url from 
the Service Credentials from your Bluemix MessageHub service) 
e Acks: 1 


E Properties £2 fr Problems 9E Outline Ñ Tasks FE Deployment Log 


| KafkaProducer Node Properties - KafkaProducer MessageHub 


eege, 
Basic Topic name* employee 
GERS Bootstrap servers* [kafka0 1-prod02.messagehub.services.eu-gb.bluemix.net:9093.  — 
Validation | e.g. bootstrap.server.com:9092 (multiple servers can be specified and delimited using a ` 7 
|___Fan [nn 
Add IIB suffix to dientID M 
Acks* 
Timeout (sec)* foo. 7 7 
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11. Onthe Security tab, set the security protocol to SASL_SSL. 


E Properties "7 [fi Problems gE Outline $% Tasks FE} Deployment Log 


a KafkaProducer Node Properties - KafkaProducer MessageHub 


er a 
Basic Security protocol* SR) 
Security SSL protocol cannot be set if Security protocol is PLAINTEXT or SASL_PLAINTEXT 
[Validation ss) protocol* [msvi.2 — 
— 


12. When connecting to a secure Kafka server, such as MessageHub, the required security 
credentials are provided by the IIB node. Security credentials are created with the 
“masisetdbparms” command. 


In an IIB Command Console, run the following command, substituting values for your IIB 
server, username and password as appropriate (user and password are those provided by 
the MessageHub credentials). 


mqsisetdbparms TESTNODE_iibuser 
-n kafka: :KAFKA: :default 


-u yt3ApcyC1TbrJ7H9 
-p nb0zXz466PHOcRvDmNAhhwZ3FdBgJoR1 


13. Stop and restart the IIB node. 


14. Save the subflow, and deploy the updated HR_Service in the usual way. 
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6.2 Test HR_Service with MessageHub 


1. Return to the SOAPUI application that was used earlier. Change the EMPNO to a value that 
has not been previously used. 


Click the green arrow to invoke. 


8 wës Endpoint R 
b e fost lester H 


+ 2. wi) we a ©: 


av EE 
Media Type[spoicaton/sen |”) D [Post Querys... 


{ 


"Employee": { 


"FIRSINME": "Albert", 
"MIDINIT": "J", 
"LASTNAME"- "Einstein", 
"WORKDEPT": "A00", 
"BHONENO": "5012", 
"HIREDATE": "2016-12-12", 
"JOB": "MGR", 

"EDLEVEL": 9, 

"SEX": "M", 

"BIRTHDATE": "1879-03-14", 
"SALARY": 20000, 

"BONUS": 5000, 

"COMM": 1024 
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2. Note that to connect a client directly to the MessageHub system, you can use a variety of 
client tools. In all cases, you will have to configure appropriate security components to 
enable SSL or SASL-style connectivity, which is beyond the scope of this lab. You may wish 

to explore further aspects of the Bluemix Message Hub user interface such as the Grafana 


tools for example. 


Manage Service Credentials 


Partitions: 1 used / 100 maximum 


[slelelm| 


Partitions 


Retention (hours) Metrics & Logs 


Topic Names 


z employee 1 24 Grafana provides metrics, 
dashboards and graphs for 
Message Hub: 


GRAFANA 77 


END OF KAFKA LAB SCENARIO 
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7. LOOPBACK LAB: Introduction and Preparation 
7.1 Introduction 


IIB v10.0.0.6 introduced a new Loopback Request node, and this can be used to access databases such 
as MongoDB. 


This lab provides a basic example of retrieving information from a MongoDB database. It is based ona 
previously built REST API, and will retrieve Employee documents from the HRDB database (EMPLOYEE 
container), located within a MongoDB instance. 


IIB v10, fixpack 5 (10.0.0.5) has made significant changes in the Toolkit representation of REST APIs, the 
editor functions, and with the tools provided with the Mapping Node editor. This lab will make use of those 
functions to extract the required employee number from the input parameters. An approach is also 
provided to retrieve the same information using ESQL. 


7.2 Open the Windows Log Monitor for IIB 


A useful tool for IIB development on Windows is the IIB Log Viewer. This tool continuously monitors the 
Windows Event Log, and all messages from the log are displayed immediately. 


From the Start menu, click IIB Event Log Monitor. The Monitor will open; it is useful to have this always 
open in the background. 


ER 118 Event Log Monitor -loj x| 


< IB1ØNODE.serveri > The HTTP Listener has started listening on port d. 
*7?800’’ for ’’http’’ connections. [16/3/2614 3:17:23 PM] 

< IBIGNODE.serverl > Execution group finished with Configuration messa 
ge. [16/3/2614 3:17:24 PM] 

< IB1i8NODE.serveri > Configuration message received from broker. [16/3 
2814 5:87:36 PM] 

< IBiBNODE.serveri1 > About to ’’Change’’ an execution group. [18/37/7261 

PM] 

< IBIGNODE.serverl > About to ’’create ’’ the deployed resource ’’ Empl 
oyeeService_JSONClient’’ of type ’’.APPZIP’’. [16/3/2614 5:87:37 PM] 

< IBI@NODE.serveri > About to ’’create ’’ the deployed resource ’’ gen. 
getEmployee_EmployeeService_EmpServClient_JSON1’’ of type ’’ .SUBFLOW’. [16/3/26 
14 5:87:37 PM] 

< IB1iBNODE.serveri1 > About to ’’create ’’ the deployed resource ’’Emp$ 
ervClient_JSON1’’ of type ’’ .MSGFLOW’’. [16/3/2614 5:67:37 PM] 

< IBIG@NODE.serverl > Execution group finished with Configuration messa 
ge. [16/3/2614 5:67:43 PM] 

< IB1i8NODE.HTTPListener > The HTTP Listener has started listening on p 
ort ’’7888’’ for ’’http’’ connections. [16/3/2614 5:87:47 PM] 

< IBiBNODE.serveri > Configuration message received from broker. [18/3 
/2614 5:58:41 PM] 

< IBI@NODE.serveril > About to ’’Change’’ an execution group. [18/37/7261 
4 5:58:41 PM] 

< IBI@NODE.serveri > About to ’’delete ’’ the deployed resource ’’Emp$ 


This tool is not shipped as part of the IIB product; please contact us directly if you would like a copy. 
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7.3 Configure TESTNODE _iibuser for REST APIs 


The instructions in this lab guide are based on a Windows implementation, with a user named 
“iibuser”. Login to Windows as the user "iibuser", password = "passwOrd". (You may already 
be logged in). Start the IIB Toolkit from the Start menu. 


The IIB support for the REST API requires some special configuration for the IIB node and server. Cross- 
Origin Resource Scripting (CORS) must be enabled for the IIB node to execute REST applications. This 
is also required when testing with the SwaggerUI test tool. See 


http://www.ws3.org/TR/cors/?cm mc uid=09173639950214518562833&cm mc sid 50200000=1452177 
651 for further information. 


5. Ensure that TESTNODE _iibuser is started. 


6. Check that CORS has been enabled on the IIB node by running the following command in an 
Integration Console: 


mqsireportproperties TESTNODE_iibuser 
-e default 
-o HTTPConnector 
-r 


7. If CORS is enabled, you will see the following lines (amongst others): 


corsEnabled='true' 
corsAllowOrigins='*' 
corsAllowCredentials='false' 
corsExposeHeaders='Content-Type' 
corsMaxAge='-1' 
corsAllowMethods='GET, HEAD, POST, PUT, PATCH, DELETE, OPTIONS' 
corsAllowHeaders='Accept ‚Accept-Language, Content-Language, Content- 

Type' 


8. If CORS has not been enabled, run the following commands: 
mqsichangeproperties TESTNODE_iibuser 
-e default 
-o HTTPConnector 
-n corsEnabled -v true 


mqsistop TESTNODE_iibuser 


mqsistart TESTNODE_iibuser 
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8. Create the HRDB database in MongoDB 


This chapter will provide some very basic instructions to get you started with MongoDB, sufficient to 
perform this lab. There are many good instructional documents on the internet, starting with this site: 


https://www.mongodb.org/. 


Note - on the IIB Workshop Windows system, MongoDB has been installed into the Program Files folder, 
and c:\Program Files\MongoDB\server\3.2\bin has been added to the PATH in the Windows System 
Environment Variables. 


8.1 Start the MongoDB server and client shell 


1. Ina Windows Command Prompt, navigate to: 
c:\student10\Loopback\mongodb\commands 


Run the command: 
startMongoDB 


For info, this will run the MongoDB command: 
mongod.exe --dbpath c:\student10\Loopback\mongodb\data\db 


This command will start the MongoDB server, and create any new databases in the specified 
folder. The folder specified in the dbpath parameter must exist, but does not need any 
specific preparation or configuration. 


No defaults have been changed, so the MongoDB server will start with the client listener 
27017. The DOS window will be held open at this point. Do not close this window, or the 
MongoDB server will terminate. 
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2. Start a Mongo client shell. 
Open a new Windows Command Prompt, and execute the command "mongo". 
This will use the default port of 27017, and connect to the started server. 


Note that the mongo client will initially connect to the server, and will connect to the test 
database. 


:\Users\11buser>mongo 

2816-65-63T109:39:58.417+8186 I CONTROL [main] Hotfix KB2731284 or later update is not installed, wi 
11 zero-out data files 
MongoDB shell version: 3.2.5 
connecting to: test 
Welcome to the MongoDB shell. 
For interactive help, type "help". 
For more comprehensive documentation, see 

http://docs .mongodh.org/ 
Questions? Try the support group 

http://groups .google .com/group/mongodb-user 
Server has startup warnings: 
2816-85-83109:39:58.796+8188 I CONTROL Linitandlisten] 
2616-05-63T69? -39:56.796+6166 I CONTROL Linitandlisten] ** WARNING: Insecure configuration, access c 
ontrol is not enabled and no --bind_ip has heen specified. 
2816-85-83189:39:58.791+8188 I CONTROL Linitandlisten] ** Read and write access to data an 
d configuration is unrestricted, 
2816-85-63189:39:58.792+8188 I CONTROL Linitandlisten] zem and the server listens on all au 
ailable network interfaces. 
2816-85-83109:39:58.793+8188 I CONTROL Linitandlisten] 
> 
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8.2 Create the HRDB database 


With MongoDB, it is not necessary to explicitly define a database. A database is created on first 
reference, so you will do this now. 


3. As mentioned above, the default database connection is "test", so switch to the required 
database name by issuing the mongo shell command : 


use HRDB 


> use HRDB 
switched to db HRDB 
> 


4. The lab has provided a set of data for the HRDB database. In Windows Explorer, locate the 
fle c:\student10\Loopback\mongodb\createDB\ 
HRDB_Employee_batch_load. json 
Open this file with Notepad++. 
You will see the familiar contents of the HRDB EMPLOYEE data in JSON format. 


Each line has a "{" initiator and "}" terminator. 


=] HRBD_Employee.json x] 


{EMPNO: "000010",FIRSTNME: "CHRISTINE",MIDINIT: "I", LASTNAME: "HAAS",WORKDEPT: 


{EMPNO: "000020", FIRSTNME: "MICHAEL",MIDINIT: "L",LASTNAME: "THOMPSON",WORKDEPT: " 


{EMPNO: "000020", FIRSTNME: "MICHAEL",MIDINIT: "L",LASTNAME: "THOMPSON",WORKDEPT: " 
4 {EMPNO: "000030", FIRSTNME: "SALLY",MIDINIT: "A", LASTNAME: "KWAN",WORKDEPT: "C01",P 
am PRM RIAL ADA ASD L LR SOME. na A TARNED MIDI NA Aam BA ARARRNAME mU AR KERR, QR ERA welt z 


Close the file without saving any changes. 
5. You will now import this json data into a “Collection” called EMPLOYEE in the HRDB database. 
In a new Windows command prompt (not the window running the mongo shell), navigate to: 
c:\student10\Loopback\mongodb\createDB\ 
Enter the command: 
mongoimport --db HRDB 
--collection EMPLOYEE 


--drop 
--file HRDB_Employee_batch_load. json 


This command will create a collection called EMPLOYEE and import the json data in 
HRDB_Employee_batch_load. json (deleting any previous collection). 
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6. The mongo import command will respond similar to the following: 


2016-05-12T16:34:12.710+0100 connected to: localhost 
2016-05-12T16:34:12.714+0100 dropping: HRDB.EMPLOYEE 
2016-05-12T16:34:12.742+0100 imported 44 documents 


7. Check that you can retrieve an entry from the Collection. 
In the window running the Mongo client shell, execute the command: 
db.EMPLOYEE. find ( { EMPNO: "000010" } ) 


This should return a single document containing the details of employee 000010;. 


> db.EMPLOYEE.find({EMPNO: "000010"}) 


{ "id" : ObjectId ("57347fce015454d44dea9d45"), "EMPNO" : "000010", "FIRSTNME" 
"CHRISTINE", "MIDINIT" : "I", "LASTNAME" : "HAAS", "WORKDEPT" : "A00", "PHONENO" 
"3978", "HIREDATE" : "1995-01-01", "JOB" : "PRES ", "EDLEVEL" : 18, "SEX" : "EF", 
"BIRTHDATE" : "1963-08-24", "SALARY" : 152750, "BONUS" : 1000, "COMM" : 4220 } 


8. Finally, you can select all documents, by using the command 


db.EMPLOYEE.find () 


> db. EMPLOYEE. find () 

am ObjectId("5734a274015454d44dea9d70"), "EMPNO" : "000020", "FIRSTNME" 
"MICHAEL", "MIDINIT" : "L", "LASTNAME" : "THOMPSON", "WORKDEPT" : "B01", "PHONENO" 
"3476", "HIREDATE" : "2003-10-10", "JOB" : "MANAGER ", "EDLEVEL" : 18, "SEX" : "M", 
"BIRTHDATE" : "1978-02-02", "SALARY" : 94250, "BONUS" : 800, "COMM" : 3300 } 

"_ id" : ObjectId("5734a274015454d44dea9d71"), "EMPNO" : "000010", "FIRSTNME" 
"CHRISTINE", "MIDINIT" : "I", "LASTNAME" : "HAAS", "WORKDEPT" : "A00", "PHONENO" 
"3978", "HIREDATE" : "1995-01-01", "JOB" : "PRES ", "EDLEVEL" : 18, "SEX" : "F", 
"BIRTHDATE" : "1963-08-24", "SALARY" : 152750, "BONUS" : 1000, "COMM" : 4220 } 

H id" : ObjectId("5734a274015454d44dea9d72"), "EMPNO" : "000020", "FIRSTNME" 
"MICHAEL", "MIDINIT" : "L", "LASTNAME" : "THOMPSON", "WORKDEPT" : "B01", "PHONENO" 
"3476", "HIREDATE" : "2003-10-10 Nennen « . etc 


9. Now that you have loaded some test data into the MongoDB database HRDB, the next 
chapter will show you how to access this from IIB. 
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9. Configure the IIB installation 


You can use a LoopBackRequest node in a message flow to access or create records through a 
LoopBack connector. First, you must install your chosen connector to work with IBM Integration Bus, and 
then configure the data source for the connector. You can then specify the security credentials that are 
required to access it. The following topics describe the steps involved in completing those tasks: 


1. Installing the LoopBack connector 
2. Configuring the data source and models for your LoopBack connector 
3. Optionally - specifying security credentials for connecting to a secured data source 


9.1 Install the LoopBack Connector 


12. 


If you happened to run the preceding Kafka lab, then close any command windows which 
may be open. Then, open an Integration Bus Command Console, change directory to the 
node_modules folder of the work path directory (defined by the MQSI_WORKPATH 
environment variable): 


cd \ 
cd %MOSI_WORKPATH%\node_modules 


Install the required loopback connector for MongoDB by running the command 
npm install loopback-connector-mongodb 


This will create the folder node-modules, which contains the loopback connector for mongodb. 
("npm" is anodejs command, which is installed on the workshop Windows system.) 


The output of the command should look like this. You can use Windows Explorer to check the 
contents of the connectors\node_modules folder. 
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9.2 Configure data source for Loopback connector 


When you have installed a LoopBack connector to be used with IBM Integration Bus, you must configure 
the data source for the connector, by adding a connector-specific data-source stanza to the 
datasources.json file. 


1. The creation process for the loopback connector does not automatically create the 
datasources.json connections details, so this must be created manually. Depending on 
your VM image this may already have been done for you, so read through these steps 
just to make sure ... 


In this example, we have provided the required datasources file, so using Windows Explorer, 
copy the file c:\student10\loopback\mongodb\config\datasources. json. 


Paste this file into the folder into the MQ@SI_WORKPATH\connectors/loopback folder. On 
the provided Windows workshop system, this folder will be 
c:\ProgramData\IBM\MQSlI\connectors\loopback. 


Using Notepad++, open this file and take a look at the contents. The required stanza is the 
“mongodb” stanza, which corresponds to the data source name in the Loopback node 
properties in the IIB Toolkit. If you are using your own installation, you will need to change 
the hostname and port values accordingly. 


[H datasources json x] 
1 {i 
2 "memory": { 
d "name": "memory", 


"connector": "memory", 


5 "file": "c:/student10/loopkack/mongodh/memory/mydata-igoR” 


: í 

B "host": "berawarks-esb10"”, 
9 "port": 27017, 

10 "database": "HRDB", 

11 "name": "mongodk”, 

12 "connector": "ponaggdk” 
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10. Create an IIB REST API to access MongoDB 
10.1 Create the new REST API 


1. Inthe IIB Toolkit, create a new workspace called 
c:\user\iibuser\IBM\IIBT10\workspace_loopback 
Use File, Switch workspace, Other .... to do this. 
Note that it is important to restart the IIB Toolkit at this point, and to create a new workspace. 
The changes that you made to the MQSI_LWORKPATH in section 3 can only be picked up by 
the IIB Toolkit after a restart. 


2. Inthe workspace, create a new REST API.. 


New... || 
Je 


New Artifact 

ag Message Flow 

IË subflow 

[E? Message Model... 
B Message Map 
EÈ ESOL File 

Ei Decision Service 
ki Mo Service 

S Database Service 
Quick Start 


Start by creating an application 
Start by creati 


Ry Start from WSDL and/or XSD files 


ER Start by discovering a service 
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3. Name the new service HR_Service_MongoDB 
Select "Import resources and operations defined in a Swagger document". 


WS ois 


Click Next. 


© Create a REST API 


Create a REST API 
A REST API is an application that implements a RESTful interface. 


API base path 


FETSIOn 
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4. Using the Browse button, import the JSON document 


c:\student10\REST_ API HR Service\resources\ 
HR_Employee_and_Department_Services. json 
@ Create a REST API 


Create REST API from definition file 
Create a REST API from an existing Swagger 2.0 document. 
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5. The summary window will show you all of the REST operations that were defined in the 
JSON document. These operations were constructed to match the EMPLOYEE and 
DEPARTMENT tables in the HRDB database. 


Note there is an operation named getEmployees (ie. retrieve a list of all employees), and an 
operation named getEmployee. This lab will implement the getEmployee operation. 


Click Finish. 
® create a REST API -Jolx| 
Review the imported REST API definition. ~ 
Review the list of resources and operations that are specified in the REST API = 
definition. — —m 


Title: HR Employee and Department Services 


Description: This is the HR Swagger document for the Employee and Department Services used 
by the IIB BetaWorks REST labs. It contains resource definitions and JSON model definitions. 


Base path: /HR_Services/resources 


Version: 3.0.0 


/departments 
createDepartment {departments 
getDepartment /departments/{departmentKey} 
updateDepartment /departments/{departmentKey} 
deleteDepartment /departments/{departmentKey} 
getDepartmentEmploy /departments/{departmentKey}/employees 
getDepartmentManager /departments/{departmentKey}/manager 
setDepartmentManager /departments/{departmentKey}/manager 
getEmployees [employees 
createEmployee /employees 
getEmployee /employees/{employeeNumber} 
updateEmployee /employees/{employeeNumber} 
deleteEmployee /employees/{employeeNumber} 
getEmployeeDepartment /employees/{employeeNumber}/department 
setEmployeeDepartment /employees/{employeeNumber}/department 
predictSalary /employees/{EDLEVEL}/predictSalary 
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6. |The swagger document has now been imported into the Integration Toolkit. The import 
process has also created a base REST application and a message flow that implements the 
REST API. 


The imported and generated items are split into five main sections in the REST API editor: 


Page 57 of 76 
IBM InterConnect 


Header - containing the base URL for the REST API, title and description 
Resources - containing all the resources from the swagger document, and all of the 
operations that are contained within each resource 

Model Definitions - schema definitions for the input and output JSON objects 

Error Handling - options to add some elements of runtime security 

Security - basic security parameters 
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HR Service 52 


» Header 


~ Resources 


> /departments 

> /departments/{departmentKey} 

> /departments/{departmentKey}/employees 
> /departments/{departmentKey}/manager 
> /employees 

> /employees/{EDLEVEL}/predictSalary 

> /employees/{employeeNumber} 


> /employees/{employeeNumber}/department 


~ Model Definitions 


<Enter a unique name to create a new model> 
{--} EMPLOYEE 
{--} DEPARTMENT 
{--} DBRESP 
LA EmployeeResponse 
{...} DepartmentResponse 
LA DetailedResponse 


HH Ae & & 
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7. Asan example of Resources, expand /employees/{employeeNumber}. (You may wish to 
collapse the /department resource, for readability). 


You will see three operations, GET, PUT and DELETE. 


For some of the operations (for example, the updateEmployee PUT operation in this 
resource), the Schema type has been set (in this case to EMPLOYEE). 


For some other operations (for example the getEmployee GET operation), the input 
parameter is specified (EMPNO). The Schema Type of the successful (200) operation has 
been set to EmployeeResponse (originally specified in the swagger doc). 


You can use the Schema Type dropdowns to change the required schema for the operation. 


The available values are derived from the Model Definitions section. If no schema type is 
specified, the REST operation can dynamically specify the format of the output message. 


v /employees/{employeeNumber} 


[Retrieve the details for an employee 
Name Parameter type Data type Format Required Description 
employeeNumber path string e IR 7m 


Response status Description Array 


500 Something wrong in Server (m 
404 The employee cannot be found ml 


Name Parameter type Data type Format Required Description 


employeeNumber path string X RB The employee number (employeeNumber) of the employee to be updated 


Response status Description u Schema type Allow null 
ET i i fo E ER 
Ian ` ` JA problem occurred updating theempoye E Ln? & 
Ian" [There was a problem af Gerges ` E Is = 
[o Te ege metbe baus ` E E 


vom ` Deletes an existing employee in he database. 


Name Parameter type Data type Format Required Description 
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8. Expand the REST API Resources, and position the editor at the 
/employees/{employeeNumber} resource. 


The getEmployee operation is the first operation in this resource. 


v /employees/{employeeNumber} 


[SA [getemployee Žž < |] [Retieve the detais for an employee 
Name Parameter type Data type Format Required Description 
employeeNumber path Jo mg 
Response status Description Array Schema type 
BB EmployeeResponse 7 
[500 | [Something wrong in see | BE E | 
[o | [The emgoues ante. © Pens 


9. Inthe top right part of the description, click on the icon to "Create a subflow for the 


operation". 
Retrieve the details for an employ ©; 
Required Description (©) 
E) 


This will create a skeleton subflow where you will provide the logic to implement the 
operation: 


Input Output 
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Two alternatives are provided in this lab: 


1. Inthe first alternative, you will use a new Mapping node to set the value of the LocalEnvironment 


filterString element that is used by the Loopback Request node. 


2. Inthe second alternative, you will use an ESQL Compute node to set the value of the filterString 


element. 


If you wish to use ESQL, skip to "10.3 Alternative 2 - using ESQL". 


10.2 Alternative 1: Set LocalEnvironment "filterString" 


Mapping Node 


1. Add anew Mapping node to the flow editor; call it setFilterString. 


*getEmployee.subflow &3 


<2 Palette 


ele te 
Ve 


| Flow Exerciser: 


using 


C Favorites 
(na WebSphere MQ 
MATT 

Luz IMS 

Lol SCA 

\.u: WebSphere Adapters 
Ch Routing 

Ind. NET 

CE Transformation 
ZS .NETCompute 
£ Mapping 
Zë XSLTransform 
SÉ Compute 
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2. Open the new map. At the New Message Map window, accept the default (Message Map for 
REST API operation getEmployee), and click Finish. 


& New Message Map 


Specify a new message map file 
Select map type, container, name, and broker schema for the new map. 


Schemar ha | 


EES 


3. Note that LocalEnvironment has already been added to the input message assembly. 


Expanding this, and the REST folder, will show the inout parameter employeeNumber. You 
will use this when setting the value of the output filterString parameter for the MongoDB 
access. 


[E] Operation [0..1] string 


S f choice of cast items S WS 
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4. On the output message assembly, the LocalEnvironment has not been added, so add it now. 


Right-click the Message Assembly title, and select "Add or remove headers and folders". 


5) [55 Message Assembly 

Fe <Click to filter... > 
gf] Properties ` 
[E] BLOB 


Undo 

Rego 

REVEL 

Cut Cla 
Copy. fm 


Paste: Gory 


5. Select LocalEnvironment, then click OK. 
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6. Inthe output LocalEnvironment, fully expand the Destination/Loopback/Request folder. 


You will see several elements. For this scenario, you will use the filterString element. 


E [E] Loopback [0..1] _LoopbackDestinationType 


& [E] Request [0..1] _LoopbackRequestType 
[E] operation [0..1] string 


[€] externalldName [0..1] string 


Bet iin N >... WE 


7. Right-click filterString, and select "Add Assign" from the context menu. 


[e] filterString 
& [e] filter 
[e] where 
[e] limit 
[e] skip 
Œ [€] order 
& [E] field 
elany 
[E] timeoutMilliseconds 
Œ [E] CallableFlow 
Œ [e] WrittenDestination 
= [€] Aggregation 
Œ [€] DecisionServices 
Œ [e] HTTP 
Œ [e] File 
Œ [e] SOAP 
Œ [e] SCA 


Girit% 
Gtri+G 


Gre 
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8. Click the blue drop-down arrow on the Assign transform, and using the search field, change 
the transform to a "fn:concat". 


| te %, fn:contains | 
EI Date and Time Functions | 
| = $ fn:seconds-from-dateTime 
i- $ fn:seconds-from-duration 


9. The Concat transform needs to take input from the EMPNO input element, so a connection 
to this has to be provided. 


Right-click the "fn:concat" transform and select "Quick link from Input". 


= 


re Ee ee DEER 
< Undo 
Redo 
Revert 
of Cut Ctrl+x 
Copy Ctrl+C 
Paste Girly 
6 Delete 
gf Add output Ctrl+Shift+N, O 


Quick Link from Input 
rL....- mmmabmamn u 
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10. Inthe yellow pop-up window, collapse the Properties folder, expand the LocalEnvironment 
folder, and locate the REST/Input/Parameters folder. 


Select (click) the employeeNumber element. 


v 


[E] IMS : _LocalEnvironmentJMSType [0.. 1] E 
[€] Mapping : _LocalEnvironmentMappingType [0..: 
[€] Database : _LocalEnvironmentDatabaseType [0 
[E] MQ : _LocalEnvironmentMQType [0.. 1] 
[e] MOTT : _LocalEnvironmentMQTTType [0.. 1] 
[€] REST : _LocalEnvironmentRESTType [0.. 1] 
ER e Input : _RESTInputType [0.. 1] 
e ` Tel Method : string [0..1] 
E E Operation : string Ip. D 
En. [€] Path: string Ip. ı 
= [E] URL: string [0.1] 
e. E Parameters : <Anonymous> [0.. 1] 
i Kr any [1..1] 
== De employ ‚eeNumber : string [1.. 1] 
É- km Response ` _RESTResponseType [0.. 1] 
Se TimeoutRequest : eet 
> 


11. The properties of the fn:concat transform will initially show two parameters (on the General 
tab). Using the Add button, add a third one, as shown: 


Transform - concat 


SES 
I Description: 
Takes any number of arguments, converts them to strings and concatenates them, returning a single string. Fo 
example, fn:concat("Happy”, "birthday, “, "friend", “!") returns "Happy birthday, friend!” See XPath 2.0 
Specification... 


Remove 
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12. Highlight the first parameter, string1, and using the Edit button, set the value of this 
parameter to 


U {"where W : {"EMPNO" : Wel 


Click OK. 


© xpath Expression Builder 


Build an XPath Expression 


Type an XPath expression below with the help of content 
assist. Use "Insert Simple XPath" if you need more 


Insert Simple XPath... 
"were": {"EMPNO":” 
Takes any number of arguments, converts them to strings and cor 


H example, fn:concat(‘Happy”, " birthday, *, “friend”, "1") returns 4 Content assist available (Ctrl+space) 
Specification... 


13. Set the value of string2 to $employeeNumber, by using the drop-down arrow that will be 
shown when you select this element. 


Click here: 

Parameters: 

Name T 

stringi xs:string 

ring? tri 

string3 xs:string 
Result: 
Parameters: 

| Name T: Value 

stringi xs:string ‘f'where™: {"EMPNO”:” 
string2 xs:string $employeeNumber 
E 

Remove 
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14. Finally, set the value of string3 to 


rm } } T 
Parameters: 
Name T Value SP 
string1 xs:string were": {"EMPNO”:” 
string2 xs:string employeeNumber 
string3 xs:string "AM 


Save and close the map. 


15. Skip to 10.4 Complete the Flow Development. 
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10.3 Alternative 2: Set LocalEnvironment "filterString" using 
ESQL Compute Node 


1. Add anew Compute (ESQL) node to the flow editor. 


Ela *getEmployee.subflow £3 

d 2 Palette | Flow Exerciser: ; QQ 
WZALLEL a | 
(21 SCA 
(ge WebSphere Adapters 
(> Routing 
SE (e) 
CE Transformation © Konpugcl 
AM. .NETCompute 
Zë XSLTransform 


SÉ Compute 
aÑ lavaComnute 


Input Output 


2. Select the Compute node, and in the node properties, set Compute mode to 
"LocalEnvironment". 
This is required because the ESQL in the Compute node will set the value of an element in 
the Loopback folder of the LocalEnvironment. This needs to be propagated to the Loopback 
Request node, so that it can be used to pass the query to the MongoDB database. 


You can, of course, set the Compute Mode to other values, providing that the 
LocalEnvironment is included. 


EI Properties 53 oblems EC e Ji Tasks E Deployment Lo 8 ess Mm "ep 
SÉ Compute Node Properties - Compute 
Logesch 
Basic Data source [OO 
Validation Connect before flow starts E 
„Monitoring, ua) Transaction” 
ESQL module 
Compute mode* 
Treat warnings as errors 
Throw exception on database error V 
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Open the Compute node, and add a new line of ESQL after the comment line, as shown: 


3. 
-- CALL CopyEntireMessage () ; 
set OutputLocalEnvironment .Destination.Loopback.Request.filterString 


U { "where " : { UI EMPNO 1 jA we 
|| InputLocalEnvironment .REST. Input .Parameters .employeeNumber 
II "33"; 


Note, you can copy/paste this line from the file: 
c:\student10\loopback\mongodb\esql\setFilterString.esql.txt 


For reference, the ESQL will create a Loopback query element, contained in the 
LocalEnvironment/Destination/Loopback/Request/ folder. 


As an example, the query will have the following form: 
filterString = '{"where": {"EMPNO":"000010"}}' 


Save and close the ESQL editor. 
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10.4 Complete the flow development 


You will now complete the development of the subflow by using the LoopBack Request node. 


The screen captures in this section assume that the Mapping Node has been used to set the filterString, 


but apply equally if you have used an ESQL Compute node. 
1. 


From the Loopback Connectors drawer, drop a Loopback Request node onto the flow editor. 


— 


(XL SCA 


(41: WebSphere Adapters 


Routing 


Lal NET 


(Transformation 


Ci Construction 


L3 Callable Flow 


L> Cloud Connectors 


ỌPA LoopBack Connectors 
a LoopBackRequest 


LO Database 
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2. 


3. 


Select the Loopback Request node, and select the node Properties. 
On the Basic tab, set the following values: 


e Name of the data source in the datasources.json file to connect to: 
o mongodb 


e Loopback object 
o EMPLOYEE (corresponding to the HRDB EMPLOYEE container) 


e Operation 
o Retrieve 
e Timeout 


o 1200 (to avoid long timeouts during development ... Note that the screen 
capture below shows 120000 which should be changed to 1200!) 


Ca Calable Flow zg 


D 


Graph | User Defined Properties 


EI Properties X {F Problems BE Outline $T E Deployment RW "reg 


a LoopBackRequest Node Properties - LoopBackRequest 


Description 
Basic Data source name* | mongodb 
Request LoopBack object* [EMPLOYEE 
Result ; - 
= Operation [Retrieve hut ] 
Response Message Parsing 
Monitoring Security identity | 
Timeout (milliseconds) | 120000 


Connect the nodes as shown. 


Input N Ba Output 
<q- zn 
a a} » iLe] 
setFilterString oopbe ` H 


Page 72 of 76 
IBM InterConnect 


Session 9402, IBM Integration Bus 
Connect Throw nodes (Construction folder) to the failure terminals of each of the nodes. Add 
suitable message text using the properties tab. This will help with any problem determination 


4. 
you may need when you come to test the REST API: 
| N 4 H $ Ro 
Input \ i Throw N Throwi Pr; | 
\ j | Output 
VK | d 
Kä DDho ~~ 
Le iLe] g 
= ng Loopback Request 


Save the subflow. 
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10.6 Deploy and test the REST API 


You will now deploy and test the updated REST API. This should retrieve information from the MongoDB 
HRDB database. 


5. 


6. 


First, to activate the changes you made earlier (so that the IIB node can pick up the loopback 
connector from the MQSI_WORKPATH), stop and restart TESTNODE _iibuser. 


You can do this using the Integration Toolkit (right-click node, Stop, then Start), or a variety 
of other ways. 


24 Integration No... $3 24 Integration Re... ‘5. Data Proje 


Ensure all deployed resources are deleted from the default server. 


B Deploy ... 


22 In. 38 | A In... LE 
| R && Refresh 


E Of, Delete 27 All Flows And Resources 
E-a Integration Ne — ke ie 


ER, TESINODI % Launch Debugger (Port is 0) 
ag 

(4) HR_Service 
si HRDB 


% Integration Server 
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7. Inthe Integration Toolkit, deploy the HR_Service_MongoDB REST API by dragging and 
dropping onto the default server. 


Ki Application D... 53 82, Patterns Explo... 


Application Development 


Elg Integration 


E 


8. Inthe supplied Firefox browser, use the shortcut in the REST folder to use the URL: 


http: //localhost:7800/HR_Services/resources/employees/000010 


terro Bo 
A Search or enter address 


_) oom Lime _) was gel i REST |) 10T |_) Healthcare ` ` Registration ` ` Cloud |} Buid ` ` Feedback ` ` Mobile 


iÐ TESTNODE_ibuser - IBM Inte... % 


Employee 000010 
http: /flocalhost: 7800/HR_Services/resources/employees/0000 10 
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9. This should retrieve the document corresponding the EMPNO = "000010". 


Së TESTIHOUE user - IM Inte wv http://localhost...employees/000010 x 


ds ) © | localhost: 7800/HR_Services/resources/employees/0000 10 K | Q search 


om |) IB |) WAS | j SDS _) REST ` IOT |} Healthcare |_| Registration | Cloud |. Build |_| Feedback ` ` Mobile 


[{"id":"57402e720706a97ec5cfe859", "EMPNO" : "000010", "FIRSTNME" : "CHRISTINE", "MIDINIT": "I", "LASTNAME" : "HAAS", "WORKDEPT" :"A00' 
ES ","EDLEVEL":18, "SEX": "F", "BIRTHDATE": "1963-08-24", "SALARY":152750, "BONUS": 1000, "COMM":4220}] 


10. Terminate the mongo shell window, and the mongodb server window, using Ctrl-C in both 
cases. 


END OF LOOPBACK LAB SCENARIO 
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